Cancer cell invasion: Caveolae and invadosomes are partners in crime.

During cancer progression, tumor cells need to disseminate by remodeling the extracellular tumor matrix. A recent study sheds light on the intricate cooperation between caveolae and invadosomes that facilitates the spread of cancer cells.

A Model for Membrane Degradation Using a Gelatin Invadopodia Assay.

One of the most crucial and lethal characteristics of solid tumors is represented by the increased ability of cancer cells to migrate and invade other organs during the so-called metastatic spread. This is allowed thanks to the production of matrix metalloproteinases (MMPs), enzymes capable of degrading a type of collagen abundant in the basal membrane separating the epithelial tissue from the connective one. In this work, we employ a synergistic experimental and mathematical modelling approach to explore the invasion process of tumor cells. A mathematical model composed of reaction-diffusion equations describing the evolution of the tumor cells density on a gelatin substrate, MMPs enzymes concentration and the degradation of the gelatin is proposed. This is completed with a calibration strategy. We perform a sensitivity analysis and explore a parameter estimation technique both on synthetic and experimental data in order to find the optimal parameters that describe the in vitro experiments. A comparison between numerical and experimental solutions ends the work.

FilGAP, a GAP for Rac1, down-regulates invadopodia formation in breast cancer cells.

Invadopodia are protrusive structures that mediate the extracellular matrix (ECM) degradation required for tumor invasion and metastasis. Rho small GTPases regulate invadopodia formation, but the molecular mechanisms of how Rho small GTPase activities are regulated at the invadopodia remain unclear. Here we have identified FilGAP, a GTPase-activating protein (GAP) for Rac1, as a negative regulator of invadopodia formation in tumor cells. Depletion of FilGAP in breast cancer cells increased ECM degradation and conversely, overexpression of FilGAP decreased it. FilGAP depletion promoted the formation of invadopodia with ECM degradation. In addition, FilGAP depletion and Rac1 overexpression increased the emergence of invadopodia induced by epidermal growth factor, whereas FilGAP overexpression suppressed it. Overexpression of GAP-deficient FilGAP mutant enhanced invadopodia emergence as well as FilGAP depletion. The pleckstrin-homology (PH) domain of FilGAP binds phosphatidylinositol 3,4-bisphosphate [PI(3,4)P2], which is distributed on membranes of the invadopodia. FilGAP localized to invadopodia in breast cancer cells on the ECM, but FilGAP mutant lacking PI(3,4)P2-binding showed low localization. Similarly, the decrease of PI(3,4)P2 production reduced the FilGAP localization. Our results suggest that FilGAP localizes to invadopodia through its PH domain binding to PI(3,4)P2 and down-regulates invadopodia formation by inactivating Rac1, inhibiting ECM degradation in invasive tumor cells.Key words: invadopodia, breast carcinoma, Rac1, FilGAP, PI(3,4)P2.

ERß promoted invadopodia formation-mediated non-small cell lung cancer metastasis via the ICAM1/p-Src/p-Cortactin signaling pathway.

In a previous study, our research group observed that estrogen promotes the metastasis of non-small cell lung cancer (NSCLC) through the estrogen receptor ß (ERß). Invadopodia are key structures involved in tumor metastasis. However, it is unclear whether ERß is involved in the promotion of NSCLC metastasis through invadopodia. In our study, we used scanning electron microscopy to observe the formation of invadopodia following the overexpression of ERß and treatment with E2. In vitro experiments using multiple NSCLC cell lines demonstrated that ERß can increase the formation of invadopodia and cell invasion. Mechanistic studies revealed that ERß can upregulate the expression of ICAM1 by directly binding to estrogen-responsive elements (EREs) located on the ICAM1 promoter, which in turn can enhance the phosphorylation of Src/cortactin. We also confirmed these findings in vivo using an orthotopic lung transplantation mouse model, which validated the results obtained from the in vitro experiments. Finally, we examined the expressions of ERß and ICAM1 using immunohistochemistry in both NSCLC tissue and paired metastatic lymph nodes. The results confirmed that ERß promotes the formation of invadopodia in NSCLC cells through the ICAM1/p-Src/p-Cortactin signaling pathway.

Small extracellular vesicles promote invadopodia activity in glioblastoma cells in a therapy-dependent manner.

PURPOSE: The therapeutic efficacy of radiotherapy/temozolomide treatment for glioblastoma (GBM) is limited by the augmented invasiveness mediated by invadopodia activity of surviving GBM cells. As yet, however the underlying mechanisms remain poorly understood. Due to their ability to transport oncogenic material between cells, small extracellular vesicles (sEVs) have emerged as key mediators of tumour progression. We hypothesize that the sustained growth and invasion of cancer cells depends on bidirectional sEV-mediated cell-cell communication. METHODS: Invadopodia assays and zymography gels were used to examine the invadopodia activity capacity of GBM cells. Differential ultracentrifugation was utilized to isolate sEVs from conditioned medium and proteomic analyses were conducted on both GBM cell lines and their sEVs to determine the cargo present within the sEVs. In addition, the impact of radiotherapy and temozolomide treatment of GBM cells was studied. RESULTS: We found that GBM cells form active invadopodia and secrete sEVs containing the matrix metalloproteinase MMP-2. Subsequent proteomic studies revealed the presence of an invadopodia-related protein sEV cargo and that sEVs from highly invadopodia active GBM cells (LN229) increase invadopodia activity in sEV recipient GBM cells. We also found that GBM cells displayed increases in invadopodia activity and sEV secretion post radiation/temozolomide treatment. Together, these data reveal a relationship between invadopodia and sEV composition/secretion/uptake in promoting the invasiveness of GBM cells. CONCLUSIONS: Our data indicate that sEVs secreted by GBM cells can facilitate tumour invasion by promoting invadopodia activity in recipient cells, which may be enhanced by treatment with radio-chemotherapy. The transfer of pro-invasive cargos may yield important insights into the functional capacity of sEVs in invadopodia.

Latent membrane protein 1 and macrophage-derived TNFα synergistically activate and mobilize invadopodia to drive invasion of nasopharyngeal carcinoma.

Invadopodia are actin-rich membrane protrusions that digest the matrix barrier during cancer metastasis. Since the discovery of invadopodia, they have been visualized as localized and dot-like structures in different types of cancer cells on top of a 2D matrix. In this investigation of Epstein-Barr virus (EBV)-associated nasopharyngeal carcinoma (NPC), a highly invasive cancer frequently accompanied by neck lymph node and distal organ metastases, we revealed a new form of invadopodium with mobilizing features. Integration of live-cell imaging and molecular assays revealed the interaction of macrophage-released TNFα and EBV-encoded latent membrane protein 1 (LMP1) in co-activating the EGFR/Src/ERK/cortactin and Cdc42/N-WASP signaling axes for mobilizing the invadopodia with lateral movements. This phenomenon endows the invadopodia with massive degradative power, visualized as a shift of focal dot-like digestion patterns on a 2D gelatin to a dendrite-like digestion pattern. Notably, single stimulation of either LMP1 or TNFα could only enhance the number of ordinary dot-like invadopodia, suggesting that the EBV infection sensitizes the NPC cells to form mobilizing invadopodia when encountering a TNFα-rich tumor microenvironment. This study unveils the interplay of EBV and stromal components in driving the invasive potential of NPC via unleashing the propulsion of invadopodia in overcoming matrix hurdles. © 2022 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Heat Shock Proteins 70 Regulate Cell Motility and Invadopodia-Associated Proteins Expression in Oral Squamous Cell Carcinoma.

Background: Many studies have shown that diabetes is often closely related to oral squamous cell carcinoma (OSCC) occurrence and metastasis. Heat shock protein 70 (Hsp70) is a molecular chaperone related to diabetes complications. This study aims to investigate the role of Hsp70 in OSCC in expression of invadopodia-associated proteins. Methods: The expressions and correlation of HSP70, Hif1α, MMP2, MMP14, and cortactin were examined using bioinformatics analysis and verified by OSCC tissue microarrays. Assay in vitro was performed to analyze cell migration capacity after treatment with or without the HSP70 inhibitor. Results: The expressions of invadopodia-associated proteins were enhanced in OSCC tissues compared with paracarcinoma tissues and partially correlated with HSP70. Inhibiting HSP70 significantly decreased the cell viability, proliferation, and migration of OSCC cells. Conclusions: HSP70 may be involved in invadopodia-associated proteins in OSCC cells, which provides a promising method for treatment of OSCC metastasis.

PLXDC2 enhances invadopodium formation to promote invasion and metastasis of gastric cancer cells via interacting with PTP1B.

Plexin-domain containing 2 (PLXDC2) has been reported as an oncoprotein in several human malignancies. However, its expression and roles in gastric cancer remain largely unclear. In this study, we found that PLXDC2 was highly expressed in gastric cancer tissues, and the expression levels were positively correlated with clinicopathological features, but negatively with the patients' outcome. Cox regression analysis identified PLXDC2 as an independent prognostic indicator for the patients. Knockdown of PLXDC2 markedly suppressed the in vitro invasion and in vivo metastasis of gastric cancer cells, while overexpression of PLXDC2 resulted in opposite effects. Mechanistically, PLXDC2 enhanced the level of phosphorylated Cortactin (p-Cortactin) by physically interacting with protein tyrosine phosphatase 1B (PTP1B), an important dephosphorylase, to prevent its dephosphorylating of p-Cortactin, thereby promoting the formation of invadopodia. Collectively, our results indicate that PLXDC2 contributes to the invasion and metastasis of gastric cancer by inhibiting PTP1B to facilitate the invadopodium formation, and may serve as a potential prognostic biomarker and a therapeutic target for this disease.

Histone H3K9 methyltransferase SETDB1 augments invadopodia formation to promote tumor metastasis.

Non-small cell lung cancer (NSCLC) is one of leading causes of cancer-related mortality worldwide, which harbors various accumulated genetic and epigenetic abnormalities. Histone methyltransferase SETDB1 is a pivotal epigenetic regulator whose focal amplification and upregulation are commonly detected in NSCLC. However, molecular mechanisms underlying the pro-oncogenic function of SETDB1 remain poorly characterized. Here, we demonstrate that SETDB1 augments the migration and invasion capabilities of NSCLC cells by reinforcing invadopodia formation and mediated ECM degradation. At the molecular level, SETDB1 suppresses the expression of FOXA2, a crucial tumor and metastasis suppressor via coordinated epigenetic mechanisms - SETDB1 not only catalyzes histone H3K9 methylation on FOXA2 genomic locus, but also recruits DNMT3A to regulate DNA methylation on CpG island. Consequently, depletion of Setdb1 in murine lung adenocarcinoma cells completely abolished their full and spontaneous metastatic capabilities in mouse xenograft models. These findings together establish the pro-metastasis activity of SETDB1 in NSCLC and elucidate the underlying cellular and molecular mechanisms.

The Role of the Disrupted Podosome Adaptor Protein (SH3PXD2B) in Frank-Ter Haar Syndrome.

Frank-Ter Haar syndrome (FTHS), sometimes referred to as Ter Haar syndrome, is a rare hereditary disorder that manifests in skeletal, cardiac, and ocular anomalies, including hypertelorism, glaucoma, prominent eyes, and facial abnormalities. In this study, we performed whole-exome sequencing (WES) to identify the genetic component responsible for the phenotype of the index patient, a male infant born to a consanguineous family from Saudi Arabia. The analysis revealed a homozygous missense variant, c.280C>G, in the SH3PXD2B gene, which cosegregates with the familial phenotype with a plausible autosomal-recessive mode of inheritance, indicating a potential disease-causing association. The SH3PXD2B gene encodes a TKS4 podosome adaptor protein that regulates the epidermal growth factor signaling pathway. This study validates the critical function of the TKS4 podosome protein by suggesting a common mechanism underlying the pathogenesis of FTHS.

PYK2 mediates the BRAF inhibitor (vermurafenib)-induced invadopodia formation and metastasis in melanomas.

OBJECTIVE: The BRAF inhibitor, vemurafenib, has been widely used in the treatment of patients with melanoma-bearing BRAFV600E mutations. While the initial response to vemurafenib is usually excellent, the majority of patients eventually develop resistance and metastatic disease. However, the underlying molecular mechanism remains elusive. The objective of this study was therefore to identify additional molecular targets responsible for vemurafenib resistance. METHODS: Western blots and immunohistochemistry analyses were used to evaluate expressions of PYK2 and p-PYK2 in cultured cells and melanoma tissue microarrays. The relationships of p-PYK2 with clinicopathological parameters were statistically analyzed. Invadopodia cell invasion, and a Ca2+ assay were used to determine the effect of vemurafenib resistance-induced p-PYK2 on melanoma progression. A mouse model was used to assess the effects of PYK2 on melanoma metastasis. RESULTS: Elevated p-PYK2 levels were detected in vemurafenib-resistant melanoma cells, and PYK2 was shown to regulate invadopodia formation in melanoma cells. Vemurafenib triggered invadopodia formation by activation of PYK2. Inhibition of PYK2 with either shRNA or the small molecule inhibitor, PF562711, dramatically reduced vemurafenib-induced invadopodia formation. Furthermore, knockdown of PYK2 significantly reduced melanoma lung metastasis in vivo. Increased expressions of p-PYK2 in melanoma patients were positively correlated with advanced stage (P = 0.002), metastasis (P < 0.001), and Clark grade (P < 0.001), and were also associated with short overall survival [hazard ratio (HR) = 3.304, P = 0.007] and progression-free survival (HR = 2.930, P = 0.001). CONCLUSIONS: PYK2 mediated vemurafenib-induced melanoma cell migration and invasion. Inhibition of PYK2 resensitized melanoma cells to vemurafenib. Phospho-PYK2 was a prognostic biomarker in melanoma patients.

T-lymphoma invasion and metastasis 1 promotes invadopodia formation and is regulated by the PI3K/Akt signaling pathway in hepatocellular carcinoma.

At present, there are still many poorly understood aspects of the mechanisms underlying hepatocellular carcinoma (HCC) invasion and metastasis. Invadopodia are important structures for cancer cell invasion and metastasis. We determined that high T-lymphoma invasion and metastasis 1 (Tiam1) expression is associated with HCC invasion and metastasis and poor patient prognosis after surgery. Gain- and loss-of-function studies confirmed that Tiam1 promotes invadopodia formation in HCC by activating Rac1. A series of biochemical experiments confirmed that this effect is regulated by the PI3K/Akt signaling pathway. We also confirmed that PIP2 facilitates this effect. In summary, these findings reveal that Tiam1 plays an important role in invadopodia formation in HCC.

Bladder Cancer Invasion Is Mediated by Mammalian Target of Rapamycin Complex 2-Driven Regulation of Nitric Oxide and Invadopodia Formation.

Bladder cancer invasion depends on mammalian target of rapamycin complex 2 (mTORC2) activity, although the downstream mTORC2 effectors that mediate this effect have not been fully defined. One potential downstream effector is the arginine derivative nitric oxide (NO). This study identified a stage-associated increase in the expression of the NO-generating enzymes endothelial NO synthase (eNOS) and inducible NOS (iNOS) in human bladder cancer. Reduction of NOS activity by pharmacologic inhibition or silencing of NOS enzymes reduced cancer cell invasion, with similar effects observed using the NO scavenger cobinamide. By contrast, enhanced invasion was seen with the NO donor Deta-NONOate and an analog of the downstream NO second messenger cGMP. Next, NOS expression was evaluated in invadopodia, which are cellular protrusions that form the invasive tips of cancer cells. Invadopodia were enriched in both iNOS protein and mTORC2 activity, and invadopodia formation was increased by Deta-NONOate and decreased by cobinamide and ablation of mTORC2 activity. Additionally, mTORC2 increased expression of iNOS. Using a zebrafish model, injection of iNOS- or rictor-silenced cells reduced the frequency of bladder cancer cell metastasis in zebrafish. These results indicate that mTORC2 can mediate bladder cancer cell invasion through increased iNOS expression, resulting in increased NO and cGMP production in invadopodia and further propagation of invadopodia formation.

Gelsolin Contributes to the Motility of A375 Melanoma Cells and This Activity Is Mediated by the Fibrous Extracellular Matrix Protein Profile.

Skin melanocytes reside on the basement membrane (BM), which is mainly composed of laminin, collagen type IV, and proteoglycans. For melanoma cells, in order to invade into the skin, melanocytes must cross the BM. It has been reported that changes in the composition of the BM accompany melanocytes tumorigenesis. Previously, we reported high gelsolin (GSN)-an actin-binding protein-levels in melanoma cell lines and GSN's importance for migration of A375 cells. Here we investigate whether melanoma cells migrate differently depending on the type of fibrous extracellular matrix protein. We obtained A375 melanoma cells deprived of GSN synthesis and tested their migratory properties on laminin, collagens type I and IV, fibronectin, and Matrigel, which resembles the skin's BM. We applied confocal and structured illuminated microscopy (SIM), gelatin degradation, and diverse motility assays to assess GSN's influence on parameters associated with cells' ability to protrude. We show that GSN is important for melanoma cell migration, predominantly on laminin, which is one of the main components of the skin's BM.

Invadopodia Structure in 3D Environment Resolved by Near-Infrared Branding Protocol Combining Correlative Confocal and FIB-SEM Microscopy.

Cancer cell invasion through tissue barriers is the intrinsic feature of metastasis, the most life-threatening aspect of cancer. Detailed observation and analysis of cancer cell behaviour in a 3D environment is essential for a full understanding of the mechanisms of cancer cell invasion. The inherent limits of optical microscopy resolution do not allow to for in-depth observation of intracellular structures, such as invadopodia of invading cancer cells. The required resolution can be achieved using electron microscopy techniques such as FIB-SEM. However, visualising cells in a 3D matrix using FIB-SEM is challenging due to difficulties with localisation of a specific cell deep within the resin block. We have developed a new protocol based on the near-infrared branding (NIRB) procedure that extends the pattern from the surface grid deep inside the resin. This 3D burned pattern allows for precise trimming followed by targeted 3D FIB-SEM. Here we present detailed 3D CLEM results combining confocal and FIB-SEM imaging of cancer cell invadopodia that extend deep into the collagen meshwork.

Hyaluronan synthase 2 (HAS2) regulates cell phenotype and invadopodia formation in luminal-like breast cancer cells.

Although luminal breast cancer cells are typically highly cohesive epithelial cells and have low invasive ability, many eventually develop metastasis. Until now, the underlying mechanisms remain obscure. In this work, we showed that the level of hyaluronic acid synthase 2 (HAS2) was positively correlated with the malignant phenotype of breast cancer cells. Notably, the increased expression of HAS2 promoted the invasive and migratory abilities of luminal breast cancer cells in vitro, followed by a reduced expression of E-cadherin, ß-catenin, and ZO-1, and an elevated expression of N-cadherin and vimentin. Furthermore, overexpression of HAS2 promoted while knockdown of HAS2 impeded invadopodia formation, which subsequently increased or decreased the activation of cortactin, Tks5, and metalloproteinases (MMPs). Activation of these invadopodia-related proteins was prevented by inhibition of HAS2 or disruption of HA, which in turn attenuated the increased motility and invasiveness. Further, in vivo study showed that, HAS2 increased tumor growth and the rate of lung metastasis via driving transition to an invasive cell phenotype in SCID mice that were orthotopically transplanted with luminal breast cancer cells. Collectively, our results showed that HAS2 promoted cell invasion by inducing transition to an invasive phenotype and by enhancing invadopodia formation in luminal breast cancer cells, which may provide new mechanistic insights into its role in tumor metastasis.

Lumican Inhibits In Vivo Melanoma Metastasis by Altering Matrix-Effectors and Invadopodia Markers.

It was reported that lumican inhibits the activity of metalloproteinase MMP-14 and melanoma cell migration in vitro and in vivo. Moreover, Snail triggers epithelial-to-mesenchymal transition and the metastatic potential of cancer cells. Therefore, the aim of this study was to examine the effect of lumican on Mock and Snail overexpressing melanoma B16F1 cells in vivo. Lung metastasis was analyzed after intravenous injections of Mock-B16F1 and Snail-B16F1 cells in Lum+/+ and Lum-/- mice. At day 14, mice were sacrificed, and lungs were collected. The number of lung metastatic nodules was significantly higher in mice injected with Snail-B16F1 cells as compared to mice injected with Mock-B16F1 cells confirming the pro-metastatic effect of Snail. This effect was stronger in Lum-/- mice as compared to Lum+/+, suggesting that endogenous lumican of wild-type mice significantly inhibits metastasis to lungs. Scanning electron and confocal microscopy investigations demonstrated that lumican inhibits the development of elongated cancer cell phenotypes which are known to develop invadopodia releasing MMPs. Moreover, lumican was shown to affect the expression of cyclin D1, cortactin, vinculin, hyaluronan synthase 2, heparanase, MMP-14 and the phosphorylation of FAK, AKT, p130 Cas and GSK3α/ß. Altogether, these data demonstrated that lumican significantly inhibits lung metastasis in vivo, as well as cell invasion in vitro, suggesting that a lumican-based strategy targeting Snail-induced metastasis could be useful for melanoma treatment.

Key proteins of invadopodia are overexpressed in oral squamous cell carcinoma suggesting an important role of MT1-MMP in the tumoral progression.

BACKGROUND: Oral squamous cell carcinoma (OSCC) is the most relevant malignant neoplasm among all head and neck tumours due to its high prevalence and unfavourable prognosis. Tumour invasion and metastasis that affect prognosis are result of a set of complex events that cells with invasive potential use to spread to other regions. These cells use several mechanisms to invade tissues, including a type of finger-like membrane protrusion called invadopodia. This study aims to investigate the immunoexpression of invaopodia related-proteins TKs5, cortactin, TKs4 and MT1-MMP in OSCC and correlate it to clinicopathological data. METHODS: An immunohistochemical evaluation of fifty cases of OSCCs and 20 cases of oral mucosa (OM) were assessed. The expression of invadopodia proteins were analysed in comparison to normal tissue (OM) and correlated to different clinical-stage and histological grade of OSCC. RESULTS: TKs5, cortactin, TKs4 and MT1-MMP were significantly overexpressed in OSCC when compared to OM (p < 0.0001). Among tumour stages, TKs5 showed a statistical difference in immunolabelling between stage I and III (p = 0.026). Cortactin immunolabelling was statistically higher in grade I than in grade II and III. No differences were seen on TKs4 expression based on tumour staging or grading. MT1-MMP was higher expressed and showed statistical difference between stages I and III and grades I compared to II and III. CONCLUSIONS: The invadopodia related-proteins were found to be overexpressed in OSCC when compared to OM, suggesting invadopodia formation and activity. Besides overexpressed in OSCC, cortactin, TKs4 and TKs5 showed no or ambiguous differences in protein expression when compared among clinical-stages or histological grades groups. Conversely, the expression of MT1-MMP increased in advanced stages and less differentiated tumours, suggesting MT1-MMP expression as a promising prognostic marker in OSCC.

Integrin-Linked Kinase Links Integrin Activation to Invadopodia Function and Invasion via the p(T567)-Ezrin/NHERF1/NHE1 Pathway.

Tumor cell invasion depends largely on degradation of the extracellular matrix (ECM) by protease-rich structures called invadopodia, whose formation and activity requires the convergence of signaling pathways engaged in cell adhesion, actin assembly, membrane regulation and ECM proteolysis. It is known that ß1-integrin stimulates invadopodia function through an invadopodial p(T567)-ezrin/NHERF1/NHE1 signal complex that regulates NHE1-driven invadopodia proteolytic activity and invasion. However, the link between ß1-integrin and this signaling complex is unknown. In this study, in metastatic breast (MDA-MB-231) and prostate (PC-3) cancer cells, we report that integrin-linked kinase (ILK) integrates ß1-integrin with this signaling complex to regulate invadopodia activity and invasion. Proximity ligation assay experiments demonstrate that, in invadopodia, ILK associates with ß1-integrin, NHE1 and the scaffold proteins p(T567)-ezrin and NHERF1. Activation of ß1-integrin increased both invasion and invadopodia activity, which were specifically blocked by inhibition of either NHE1 or ILK. We conclude that ILK integrates ß1-integrin with the ECM proteolytic/invasion signal module to induce NHE1-driven invadopodial ECM proteolysis and cell invasion.

A Fluorescent Gelatin Degradation Assay to Study Melanoma Breakdown of Extracellular Matrix.

In order to protrude within a dense tissue, tumor cells have to develop the ability to digest the extracellular matrix (ECM). Melanoma cells, similarly to other types of tumor cells, form invadopodia, membranous invaginations rich in filamentous actin and several other proteins including matrix metalloproteinases (MMPs). MMPs degrade ECM structural proteins such as collagens, fibronectin, or laminin. Here we describe an assay that allows the detection of gelatinase activity exhibited by tumor cells under 2D conditions and methods to present obtained data in both a quantitative and a qualitative manner.